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ABSTRACT. The purpose of the paper is to give a complete characterization of the con- 
tinuity of lower envelopes in the infinite dimensional spaces in terms of the notion of ir- 
regularity. As an application we introduce a variational unconstrained vector optimization 
problem for smooth functions and characterize when the variational steepest descent di- 
rections are continuous in terms of the generating sets which are considered. 



1. Introduction 

The lower envelopes of certain functions appear quite naturally in functional analysis, 
optimization, in the theory of uniform algebras and in potential theory. We investigate 
the continuity properties of lower envelopes in the abstract setting of infinite dimensional 
spaces. One can start with any set in a topological space A and assign to each point a in 
this set a fiber J a , that is, a class of elements from the dual space X* of some vector space 
X. Then one can construct a new function on A by taking lower envelopes which is ob- 
tained by considering the infimum over all numbers of the form Re x* (x), where x £ X is 
fixed, and x* changes over the fiber J a for any a £ A. To visualize things, as a model ex- 
ample one can think of x as a function which we minimize subject to some condition J a , 
where a runs in some sample space A. Then we wish to find conditions which guarantee 
continuity of these optimal values at a point a £ A. We consider fibers as multif unctions. 
As it happens the continuity of lower envelopes is a consequence of such geometric prop- 
erties of these multif unctions as upper and lower semicontinuity (Theorem |3.4|) . Roughly 
speaking, lower envelopes are continuous if and only if any limit point of fibers can be ob- 
tained as a limit of all fibers from every direction. In Section [2] we call such sets c-regular. 



This notion was introduced first in |G6g05| and |G6g06[ in the content of pluripotential 
theory for domains in C". 

As an application of this characterization we look at the problem of unconstrained 
K-minimizers. In multi-objective optimization, a special case of the problem of uncon- 
strained K-minimizers, one considers a continuously differentiable function 

F : R" — )• R m . 
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The problem is to find a minimizer of F on R M subject to the convex cone R™ of positive 
octant in R m . To explain further let 

R* = {( Xl ,...,x m ) G R m : Xj > 0, j = \,...,m) 

and we want to find a point oc G R n such that there exists no other point /3 G R M with 
F(/3) 7^ F(cx.) and F(a) — F(/3) G R!^. Recently, this problem was extended using the 
Cauchy method (or known as steepest descent method), Newton method and gradi- 
ent projection method to the problem of finding unconstrained K-minimizers in |DI04| , 
HFDS09L HFS00L and HDS05I1 . To find the K-minimizers one needs to look at the K-critical 



points of F. As in the scalar case m = 1 every K-minimizer is K-critical but not vice versa. 
The method of K-steepest descent in HDS051 provides an efficient algorithm to approx- 



imate the K-critical points. A central tool of these investigations is the so called gauge 
function G(x) for K. It allows one to measure how good the descent direction is. 

In this paper we describe this problem in the abstract setting of infinite dimensional 
spaces taking into account a family of the minimization sets and a family of objective 
values. The number of sets and objective values we consider is not necessarily finite. We 
start with a family of closed convex pointed cones K a , a £ A, in a normed linear space X, 
where A is a metric space. Let J a be a generating set for K a . On our way we consider the 
variational gauge function G(a, x) for K a defined on A x X. Using our characterization 
of c-regular sets from section [3] we completely characterize in section H] the continuity of 
G(a, x) in terms of the generating sets J a under very reasonable conditions on J a . We 
note that when E = R w , and A and S are one-point sets, we are in the same consideration 



as in the work [DS05J and in this case the continuity of the gauge function is trivial. 



Let £ = R M and consider a family 

F s : R w — ?> X, s G S, 

of continuously differentiable functions indexed by some topological space S. So for each 
a G A, s G S, and oc G R w one can find the K a -steepest descent direction v\a, s, a] for F s at a 



as described in [DS05J. Since K fl -steepest descent directions are used to approximate the 
i<C fl -critical values for the functions F s it is important to characterize when the functions 
v[a,s, a] are continuous. We prove in section [4] that if the differential maps of F s are con- 
tinuous in s and if the index set A is J -c-regular, then the K a -steepest descent direction 
via, s, tx] for F s at a are continuous. 



2. C-REGULARITY 

Let A be a metric space and X be a norm space. To each element a G A we associate 
a set J a C X*. We will use the notation x* A x* when x* is a sequence in X* which 
converge weak-* to x*. Given any point a G A let S a be the class of all sequences s = {ay} 
in A which converge to a. If s G S a , then the set consists of all elements x* G X* 
so that a sequence of elements x* G J a . converges weak-* to x*. We denote by J™ s the 
set of all weak-* cluster points of J a . consisting of all elements x* G X* so that there 
exist a subsequence {aj k } of s and elements x* G J aj which converge weak-* to x*. Let 



LOWER ENVELOPES AND STEEPEST DESCENT DIRECTIONS IN VECTOR OPTIMIZATION 3 

J a €S := oojr, the closed convex hull of J/' s . We let 

<J a := ^s<J a r J a := ^s<J a > <^a := ^s<J a ' an d 3 a := ^s<Ja $ > 

where s runs through all sequences in S a . We will always assume that the following 
properties hold: 

JQ: For each a £ A the set J a is a nonempty convex weak-* compact subset of X*; 
JV. For any convergent sequence {fly} in A if x* £ J7^, then there exists a subsequence 
x* that weak-* converges; 

^72: The set J 2s is nonempty for any a £ A; 

^73: The set J7" 3 CS is weak-* compact for any a £ A and s £ S a . 

By Alaoglu's theorem the conditions JJO, J\, and J3 are satisfied for example when 
VJ ae AJa is bounded in X*. 



Remark 2.1. By principle of uniform boundedness (see HCon90[ III. 14, Theorem 14.1]) if 



the condition J3 is satisfied, then for every a £ A there exists a constant c a > so that 

1 I < c a for all x* £ J™ . 

Note that the sets Jl and i7 fl 2s are convex. Since J™ s is the set of weak-* cluster points 
of i7a 's, it is weak-* closed. Hence J' a ws is weak-* compact. It follows from these observa- 
tions that the sets j][ ws and j]- cs are convex and compact for every a £ A. It is not hard 
to see that for any s £ S a , 

J a 2s Cj a s Cjr, and J a 2s Cj a 2ws CjrcJ a \ 

A point a £ A is said to be J-c-regular if J} = J^ s . A is said to be ^/-c-regular if every 
point x £ A is jT'-c-regular. 

Remark 2.2. The classes Jl are independent of the sequence s if and only if a is c-regular. 
In this case J} = J 2s = J a is convex and compact. 

A point a £ A is said to be c\-regular {c^-regular, resp.) if the classes J„ vs {Ja S , resp.) 
are independent of the sequence s £ S a . We will first show that all different types of 
"c-regular" definitions above are equivalent. We state this problem in terms of functional 
analysis and we prove this equivalence in this general format. 

If jC is any subset of a linear space X , the closed convex hull of C is denoted by co£. 
For a compact convex subset of a normed linear space X , we denote by ext K. the set of 
all extreme points of M 

Theorem 2.3. HCon90[ V. 7 Theorem 7.8] Let tCbea compact convex subset of a locally convex 
linear space X, and C be any subset of)C. IfcoC = JC, then ext K, C C. 

Let K = {Kj} be a sequence of sets in a locally convex linear space X. We define: 
l(K) = {x : x = \imxj for Xj £ Kj}, all limit points of Kj; 

w(K) = {x : x = limxj m for some subsequence X; £ Kj m }, all cluster points of Kj} 
cw(K) = co w(K), closed convex hull of w(K). 



The following result was proved in |G6g05[ and |G6g06|. 
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Theorem 2.4. | G6g06[ Let K = {Kj} be a sequence of compact convex sets in a locally convex 
linear space X so that czv(K) is also compact. Suppose for any subsequence L = {L,} of {Kj}, 
cw(L) = civ(K). Then l(L) = w(L) = cw(K) for all subsequences L ofK. 

The above theorem allows us to show the equivalence of different c-regularities defined 
above. 

Corollary 2.5. A point a G A is c-regular if and only if it is c\-regular if and only if it is c-- 
regular. 

Proof. As noted before the classes Jl are independent of the sequence s if and only if a is 
c-regular. It's easy to see that 

c-regular =>■ Ci-regular => C2-regular 

using the definitions. 

To show that C2-regularity implies c-regularity, let s = {aj} be any sequence converging 
to a. Put K = {J aj } in Theorem IZ4l Then l(K) = J n s , w(K) = 3™ s and cw(K) = J™. 
Recall that cw(K) is compact in X*. By Theorem 12.41 Jl = J^ s for any sequence s £ S„ 
and thus Jl is independent of s. Therefore a is c-regular. □ 

3. Lower envelopes 

Given any element x in X, we define its j7"-envelope X[x,J] : A — >■ R as 

l[x;J](a) := inf (Rex*(x) : x* G J a } 

for every a € A. Let us write Xx{a) instead of Z[x; J\ (a) for simplicity if no confusion 
arise. In this section we will prove that c-regular points are exactly those where the J- 
envelopes are continuous. Let 

Xh{a) := inf | Rex* (x) : x* e j\\ , 

where jj is one of 1, s, ws, cs, 2s, 2ws or 2cs for any x G X, a G A and s G S a - We will leave 
the details of the following observation. 

Remark 3.1. X ws x(a) = X cs x(a) for any x G X, a G A and s G S a . 

The following result will be of great use. 
Proposition 3.2. Let x G X and a G A. Then there exist sequences So, to G S a so that 

(1) (Xx)*(fl) = X 1 x(a) = inf se s a X s x(a) =X to x(a); 

(2) \xx)*{a) = sup seSa X cs x{a) = X s °x(a) < X 2s x(a). 

Proof. Take a G A and suppose Xxiaf) < X 1 x(a) — e for some sequence of points fly G A 
converging to a and some number e > 0. We can find a sequence x* G J aj so that for all j, 

Re xj(x) < X 1 x(a) — e. 

There exists a subsequence x? such that x? A x* for some x* G j}. Hence, letting 

jk ->■ °°/ 

Re x*(x) < X 1 x(a) — e. 
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On the other hand X 1 x(a) < Re x*(x), which gives that 

Re x* (x) < X 1 x(a) - e < Re x* (x) - e, 

a contradiction. Thus (Xx)*(a) > X 1 x(a). 

Suppose X 1 x(a) + e < (Xx)*(a) for some point a G A and some number e > 0. We may 
find an element x* of J} so that 

Rex*(x) < l 1 x{a) + e. 

There exists a sequence Uj G A and x* G J a . such that Uj — > a and x* converges weak-* to 
x*. Since Xx{aj) < RexJ(x) for all;, 

(Xx)^(a) < limy Re x*(x) = Rex*(x) < X 1 x(a) + e< (Xx)*(a). 

This contradiction proves that X 1 x{a) = (Xx)*(a) < X s x(a) for any s G S a . Take points 
cij G A and elements x* G jT fl? . so that £o = £ limZx(ay) = (Zx)*(a) andZx(a;) = 

Re x* (x) for every j. Passing to a subsequence we may assume that x* converges weak-* 
to an element x* G .J^ . Then 

< = Rex*(x) < 

Hence (Zx)* (a) = X io x(a) and this finishes the proof of the first part. 

For the second part, if s = {bj} G S a , then we can find elements y* G ^ so that 

Xx(bj) = Rey*(x) for each /. A subsequence {y* } converges weak-* to some y* G J™ s ■ 
Then 

(Xx)*(a) > limRey* (x) = Rey*(x) > Z a ' s x(a). 

Thus, (Xx)*(a) > sup s€Sfl X cs x(fl). 

On the other hand there exist points cij G A converging to a so that limXx(fly) = 
(Xx)*(a). Let t = {cij}. There exist y* G J"^' and y*- G that weak-* converge to 
y* so that 

X wt x(a) = y*(x) = limy* (x) > \imXx(a jk ) = {Xx)*{a). 

Hence we get the first equality in (2). 

To prove the second equality note that for every j there exists an element x* G J a . 

so that Xx{a.j) = x*(x). There exists a subsequence %*■ that weak-* converges to some 

G Ja°, where we set sq = {aj k }- Then 

(Xx)*(a) = \imXx(a h ) = x*(x) > X s °x(a). 

Now given e > 0, X s °x(a) + e > Rez*(x) for some z* G Ja°. There exist z\ G J Uj that 
weak-* converge to z*. 

X s °x(a) +e > limRez^(x) > limXx(fl ; J = (Xx)*(a). 

Hence X wt x(a) = X s °x(a) = (Xx)*(a) = sup s6S X ws x(a). The result follows from Remark 
I3T1 8 □ 
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Proposition [3]2]provides the following characterization of continuity of lower envelopes 
in terms of c-regularity. 

Corollary 3.3. Let a £ Abe a point. We have the following statements: 

a. Ja CS = 3a if and only if Tx (a) = (Tx)*(a) = X 2cs x(a) for any x £ X. 

b. 3a = 3a if and only iflx(a) = (Tx)*(a) = T 1 x(a) for any x £ X. 

c. 3a S = 3a if and only ifXx is continuous at a for any x £ X. 

Proof In general we have Txia) < sup s6S T cs x(a) since the constant sequence s = {a} £ 
S a . HJ a = n seSa 3 a cs = 3a cs , we have the equality Tx(a) = sup seSa l cs x(a) = (lx)*(a). 
Conversely suppose Txia) = (Tx)*(a) for every x £ X. Suppose that there exists x* £ 
3 a \3a S f° r some s £ S a . There exist x £ X and a number r > so that 

Jx(fl) = (Zx)*0) < x*(x) < X cs x(a) - r < supX cs x(fl) = (Tx)*{a), 

seS a 

where Proposition 13.21 is used in the last equality. The contradiction shows that 3a C 3a S 
for every s £ S a . Thus 3a = 3a cs - This proves part a. The statement in part b. concerning 
(Tx)*(a) and 3} is proved similarly. 

To prove the last statement about continuity we note that 3a S — 3} implies 3a CS = 
3} = 3 a - From a. and b. Xx is continuous at a for any x £ X. To prove the converse 
suppose that (Zx)*(a) = Txia) = (lx)*(a) for every x £ X. Then 3a CS = 3} = 3a, 3} is 
closed and convex and hence 3a S = 3} for every s £ S a . This means that a is C2-regular 
and hence c-regular by Corollary [2 .51 □ 

Let F and G be topological spaces and let p : F x G — > F be the projection. A set 
JC C F x G is a multifunction on F if p(/C) = F and for each x £ F the fiber K, x = {y £ G : 
(x, y) £ /C} is compact. 

A multifunction JC is upper semicontinuous at x £ F if for every neighborhood V of JC X in 
F x G there is a neighborhood W of x in F such that /Cy C V when y £ W. A multifunction 
K, is lower semicontinuous at x £ F if for every (x,y) £ K.% and for every neighborhood V 
of (x, y) in F x G there is a neighborhood W of x in F such that K, XJ n V 7^ when y £ W. 
The following is a slightly modified version of Theorem 3.2 proved in |G6g05 [. 

Theorem 3.4. Let 3 C A x X* be a multifunction on A with fibers 3a at a £ A so that 
conditions 30-33 are satisfied. Let ao £ A. 

(1) The lower envelope Tx is upper semicontinuous at a^ for all x £ X if and only if 3 is 
lower semicontinuous at a§. 

(2) The lower envelope Tx is lower semicontinuous at for all x £ X if and only if 3 is 
upper semicontinuous at ao. 

Proof. (1) Suppose 3 is lower semicontinuous at a^. Choose x* £ 3a such that 

Rex*(x) < Tx(ao) + - 

and let 

V={x*+y*: |y*(x)|<|, y*£X*}. 
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There exists a neighborhood W of «o such that if a G W there exists x* + y* G FnJ,,. 
Then 

Tx(a) < Rex*(x) + Rey*(x) < Rex*(x) + - < Ix(a ) + e. 

Hence Tx is upper semicontinuous at «o- 

Now suppose J is not lower semicontinuous at uq G A. Then we can find an element 
x* £ i7 fl0 , a neighborhood V of x* and a sequence a^ £ A such that % — ^ fl o and J Uk (IV = 
0. Thus x* G Ja \Ja™ s - By Corollary 13.31 there exists x G X so that Zx is not upper 
semicontinuous at Uq. 

(2) Suppose J is upper semicontinuous at Uq. Let x G X and 

v = Ja + {y*: |y*(x)| <e}. 

There exists a neighborhood W of flo such that if fl G W, i7 H C V. Hence for all x* G ^ 
there exists y* G such that 

Re y* (x) - e < Re x* (x) < Re y* (x) + e. 
Taking infimum over x* G ^7^, we get 

Xx(flo) — £ < Xx(fl) 

for all a G W. Thus Tx is lower semicontinuous at flo- 

Suppose is not upper semicontinuous at some point ciq. There exist a sequence {fly} C 
A converging to a, a neighborhood V of in X* and elements x* G Jaj\{Ja Q + V). There 
exist a subsequence {x? } of {x*} that converges weak-* to an element x* G X*. Then 

x* G i7 fl g but x* G' Ja - By Corollary 13.31 there exists x G X so that Tx is not lower 
semicontinuous at Uq. □ 

If B* is an open ball of X* and X is separable, then it is known that £>* is metrizable. In 
this case Corollary 13.31 can be improved in the following way. 

Corollary 3.5. Let J C A x X* be a multifunction on A as in Theorem 13.41 Suppose that X 
is separable. Let a G A. Then Tx is upper semicontinuous at a for any x G X if and only if 

<7 'jlws 

Ua — J a 

Proof Note that j} ws = J a implies j} cs = J a so sufficiency follows from Corollary 13.31 
To prove necessity let u G J a - By Remark IZTl we may assume that J£ s is contained in 
some open ball B* in X*. Let be the open ball of radius 1/k around u in B*. Given a 
sequence s = {fly} G S a . Since J is lower semicontinuous at a by Theorem 13.41 for any k 
there exists ]\ > 1 and Uj k G J a . for all; > j^. The sequence {}ij k } converges weak-* to 

u and u G J™ s ■ Hence J a C J~a WS - The other inclusion always holds. This finishes the 
proof. □ 

Now let us consider the function ![•,•] :AxX- >M. defined by 

T[a, x] := Tx(a) 

for every a G A and x G X. It is an easy fact that the function T[a, ■] is continuous in 
the second variable x when a G A is fixed. In fact, one can show that it is Lipschitz 
continuous. Let us give the proof of this fact. 
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Proposition 3.6. The function X [a, •] is Lipschitz continuous in the second variable x when a G A 
is fixed. 

Proof To see this, let a G A be fixed and take x, y G X. Then there exists an element \i G J a 
so that 

X{x + y) (a) = Re u(x + y) = Re u(x) + Re u(y) > Xx(a) + Xy(a). 
From this inequality we have 

X[a, x] — X[a,y] < —X[a,y — x] < c\\x — y\\, 

where c = sup{||x*|| : x* G J a }. Note that c is finite due to property JO. Hence by 
symmetry 

\X[a,x] — X[a,y] \ < c\\x — y\\ 
for every x, y G X. This proves the claim that X[a, ■] is Lipschitz continuous. □ 

It is not true in general that if a function F : U x V — >■ ]R defined on some set U x V is 
separately continuous, then it is jointly continuous. For a simple example one may take 
the function F(x,y) = *! 2 when (x,y) (0,0) and F(0,0) = defined on R 2 . Then 

x +y 

F(x, •) is continuous when x G 1R is fixed, F(-,y) is continuous when y G 1R is fixed, but 
F is not continuous at (0,0). Our next result shows that for our lower envelope operator 
X\- , ■] being separately continuous is the same as being jointly continuous. We will need 
the following lemma. 

Lemma 3.7. Let Xbea normed space, Uj G X* be elements which weak-* converge to an element 
u G X*, and Xj G X be elements which converge to some element x G X. Then the numbers 
}ij{xj) converge to u(x). 

Proof. Note that we have 

\jij(xj) — u(x)\ < \uj(xj) — jij(x) \ + \uj(x) — u(x)\ < c\\xj — x\\ + \}ij(x) — u(x)\ 

for some constant c > for every /. By assumption of the lemma it is clear that the right 
hand side converges to zero as / — > 00. □ 

Proposition 3.8. Let J : A x X — >• Rfce a multifunction satisfying the properties JQ-J3. 

i. Xx is upper semicontinuous on A for every x G X if and only ifX[-, •] is upper semicon- 
tinuous on A x X. 

ii. Xx is lower semicontinuous on A for every x G X if and only ifX[-, •] is lower semicon- 
tinuous on A x X. 

iii. Xx is continuous on A for every x G X if and only ifX[-, •] is continuous on Ax X. 

Proof, iii. follows from i. and ii. One direction in these statements is trivial. We will only 
prove necessity. Let us start proving i. Suppose Xx is upper semicontinuous on A for 
every x G X. Suppose on the contrary that X\, ■] is not upper semicontinuous at some 
point (a, x) in A x X. There exist (fly, xj) G A x X which converge to (fl, x), a number 
e > and an element u G J a so that 

Re u(x) + e < X[a, x]+2e < X[aj, Xj] 
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for every j. Since by Theorem 13.41 J is lower semicontinuous at a, there exists a sub- 
sequence {aj k } and measures Vj k G Jj k so that \ji{x) — Vj k {x)\ < 1/k for every k > 1. 
By property J71 we may assume without loss of generality by passing to another subse- 
quence if necessary that Vj k weak-* converges to some measure v G X*. Then we have 

Re y(x) + e < Re Vj k {x) 

for every k > 1. As k — >• oo we get 

Re ^(x) + e < Rev(x) = Re ^(x) 

which is clearly a contradiction. This proves (the necessity of) part i. 

Now let us prove part ii. Suppose now that ■] is not lower semicontinuous at some 
point (a, x) in A x X. There exist (fly, Xy) G A x X which converge to (fl, x), a number 
e > and elements jij £ i7 fl . so that 

Re ^y(xy) + £ < Z[fly, xy] + e < x]. 

for every y. A subsequence of {uj} which we denote as the same sequence converges 
weak-* to u G J}. By Corollary 13.31 .7« = J} and hence ^ belongs to J a . By Lemma [3771 
^y(xy) converge to ^(x) and hence 

Re /*(x) + e < X[fl, x] < Re ji(x), 

a contradiction. This finishes the proof of part ii. and the proof of the proposition. □ 

4. Variational unconstrained K-minimizers and gauge functions for 

convex cones 

Let X be a normed linear space and K a convex closed pointed cone in X. Then K 
induces a partial order ^ on X which is defined by the relation 

x, y G X, x ^ y if and only if y — x G K. 

We will also consider the following order -< induced by the interior int K of K in X: 

x, y G X, x -< y if and only if y — x G int iC. 

Let E be a normed space and Q be a subset of E. Often one is interested in minimizing 
in the sense of this order a function F : O — > X, that is, find a point a G O such that there 
exists no other (5 G O with F(/3) ^ F (a) and F(/3) 7^ F(a). This is the problem of finding 
an unconstrained K-minimizer of F on O. Although in the original definitions E is consid- 
ered to be a finite dimensional space, our discussions in this section is a straightforward 
extension to infinite dimensional setting. 

We define the positive polar cone K + of K as the set 

K+ = {x* G X* : x*(x) > for every x G K}. 
Let C C K + be a weak-* compact set which generates K + in the following sense: 

K+ = coUf> fC. 
A gauge function for K is then defined as the function G : X — > IR by 

G(x) = sup x*(x). 

x*ec 
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It is clear that G is a continuous sublinear functional. Gauge function is essential for 
defining the K-steepest descent direction when the interior of K is nonempty and one con- 
siders the problem of finding a K-minimizer of a continuously differentiable function F 
(see BDI04B , HFDS09L llFSOOl , IIDS051 ). We follow in this section the exposition in IIDS051 ) 
where the case E = O = R w was considered. 

In classical optimization (single-objective) E = R M , X = R, K = R+, the set of non- 
negative real numbers and one can take C = {1}. For the multi-objective optimization 
E = R M , X = R m , m > 2, K and K + are the positive orthant of R m and we may take C as 
the canonical basis of R m . For an arbitrary closed pointed convex cone K in X, the weak-* 
closure in X* of the set C = {x* £ K + : \\x* \\ = 1} can be used. 

Given a point a. £ O we define f a '■ E — > R as 

f K (v) ■= G(DF(a)v) = sup{x*(DF(a)v) : x* £ C} 

for any v £ E, where DF(cc) : E — > X is the differential of F at the point a. Following 
HPS05H we say that a vector v € E is a K-descent direction at a point a £ Q if /« (v) < 0. It is 
a well-known fact (see [ |Luc89| Q that if v E E is a descent direction at a point a G O, then 
there exists a number to > so that 

F(a + tv) -<F(a) for all f e (0,t )- 

We say that a point a £ G is K-critical if there is no K-descent direction at a. That is to say, 
a is K-critical if / a (v) > for every v £ E. Note that a is K-critical if and only if 

-intKnlmage(DF(a)) = 0. 

The K-steepest descent direction v[a] for F at a £ O is the solution of 

min / a (v) + (l/2)||v|| 2 , v £ E. 

The optimal value of this problem will be denoted by m [a] . Note that the function v \— > 
fu(v) is real-valued closed convex, therefore, v[tx] and m\a\ are uniquely determined. 
Moreover, the maps 

(cc, v) f a (v), a. v[a], and a. i— ^ m[oc] 

are continuous (see |DS05l Lemma 3.3]). 

We will now consider a variational problem of unconstrained minimizers related to 
convex closed cones. Let A be a metric space. For every a £ A let K a be a convex closed 
pointed cone in X. Let J a C K+ be a set which generates K+. Now we consider the 
function G : A x X — >• R defined by 

G(fl,x) = sup{x*(x) : x* £ 

Clearly the function G(a, x) is continuous in the variable x when the first variable a £ A is 
fixed. We are interested in determining exact conditions which guarantee the continuity 
of the variational Gauge function G(a,x). With the notation of section |3] we have the 
relation 

T[—x,J](a) = —G(a,x) 

for every x £ X and a £ A. 

Assuming certain very reasonable properties J0-J3 on the sets J a we get necessary 
and sufficient conditions in terms of J a for the function G(a,x) to be upper or lower 
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semicontinuous or just to be continuous using Corollary 13.31 and Proposition 13.81 These 
properties are satisfied for example when the set U ae j{J' a is bounded in X*. As a conse- 
quence we obtain the following result. 

Theorem 4.1. Let A be a metric space, Xbea normed linear space, K a be a convex closed pointed 
cone in X and let J a C be a set which generates K+ for every a £ A. Suppose that the 
properties JQ-J3 are satisfied. We have the following statements: 

a. G(a, x) is lower semicontinuous on A x X if and only if ' J^ cs = J a for every a £ A; 

b. G(a, x) is upper semicontinuous on A x X if and only if J a = 3} for every a £ A; 

c. G(a, x) is continuous on Ax X if and only if A is J-c-regular. 

Let us go one step further. Let F s : E — >• X, s £ S, be a family of continuously dif- 
ferentiable functions indexed by a topological space S. When can one find a continuous 
selection of steepest K fl -descent directions? We would like to establish some conditions in 
terms of the generating sets J a which guarantee the continuity of the functions 

(a,s,oc) i — y v[a,s,ot], and (a, s, a) \- y m[a,s,ot\. 

Here we denote the steepest K fl -descent direction for F s by v[a, s, a] and the corresponding 
optimal value by m [a, s, a] . If we want to be more precise and want to emphasize the 
involvement of the functions F s in these notations we will write v [a, s, a; F s ] or m [a, s, a; F s ] 
respectively. The following result which follows from Theorem 14. 1 1 answers the question. 

Theorem 4.2. Let A, X, K a , and J a be as in Theorem |47H Let F s : R M — >■ X, s £ S, be a family 
of continuously differentiable functions so that the mapping 

s^DF s (tt) from S -> L(R" / X) 

is continuous for every a e R M . If A is J-c-regular, then the mappings 

(a,s,tx.) i — y v[a,s,oc], and (a,s,oc) >->• m[a,s,cc] 

are continuous. 

Proof. Note that by our assumption the map 

(s,a,v) H> DF s (ct)v from S x ]R M x ]R M — y R" 

is continuous. Since A is ^J-c-regular, the gauge function G(a,x) is continuous on A x X 
by Theorem 14.11 Hence the map 

K[a,s,a,v] := G[a,DF s (a)v] + (l/2)||v|| 2 from A x S x R M x R w — >• R 

is continuous. Let (ao,so,ao) be a point in A x S x R", vq = v[ao,so, olq], and let mo = 
m[flO/So/«o]- Our proof relies on the following observations: 

Claim: Given e > 0, there is an open neighborhood U of (ao,So,a.o) in Ax S x R" so that 

G[a,DF s {oc)v] + {l/2)\\vf > G[a,DF s (oc)v ] + (l/2)||v || 2 
for every v £ R M with \\v — vq\\ = e and for every (a, s, a) £ U. 

Proof of Claim: Let us assume the contrary. So there exist e > 0, vectors v\ £ R" with 
\ v k ~ v o|| = £ and points (fljt/ s fc/ a fc) which converge to (flO/SO/^o) so that 

G[a k ,DF Sk (oc k )v k ] + (1/2) ||v fc || 2 < G[a k , DF Sk (<x k )v ] + (l/2)\\v \\ 2 
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for every k. Since the set {v £ R" : ||v — vq|| = e} is compact we may assume without loss 
of generality (refining {v{\ if necessary) that the vectors v k converge to a vector v' £ R M . 
From the continuity of G we have 

\im k G[a k ,DF Sk (<x k )v k ] = G[a , DF SQ (tx )v'}. 

Hence 

G[a ,DF So (cc o y] + (l/2)||v'|| 2 < m . 

Since mo is the minimum value of the objective function k[ciq, sq, olq, v] and vq is the unique 
vector in R" which minimizes this objective function, v' = Vq, which is a contradiction 
since ||v' — vol I — e - Thus we have proved the claim. 

To finish the proof of the theorem let e > be given, and let U be the open set found 
above in the claim. Take any point (a,s,a) £ U. Letv' = v[fl,s,a] and k(v) := K.[a,s,a.,v] 
for any vector v £ R M . We will show that ||v — v'|| < e. Suppose to argue by contradiction 
that || v — v 1 1| > e. We can find a vector r\ G R" and a number < t < 1 so that 

11*711 =£, and vo + rj = tVQ + (1 — t)v' . 
Using the inequality proved in the claim we have 

fc(vo) < Hvo + V)< tk(vo) + (1 - t)k{v'). 

Thus we obtain /c(vq) < fc(v') which is clearly a contradiction to the fact that v' is the 
minimizing vector of the function k(v) in R M . Therefore ||v — v'|| < e. The proof is fin- 
ished. □ 
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